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Energy gaps in quantum first-order mean-field-like transitions: 
The problems that quantum annealing cannot solve 
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PACS 05 . 30 . -d - Quantum statistical mechanics 
PACS 05 . 70 . Fh - Phase transitions: general studies 

Abstract. - We study first-order quantum phase transitions in models where the mean-field 
traitment is exact, and the exponentially fast closure of the energy gap with the system size at the 
transition. We consider exactly solvable ferromagnetic models, and show that they reduce to the 
Grover problem in a particular limit. We compute the coefficient in the exponential closure of the 
gap using an instantonic approach, and discuss the (dire) consequences for quantum annealing. 



Many important practical problems involve the mini- 
ly—^ ■ mization of a function of discrete variables. Solving such 
\Q , combinatorial problems by temperature annealing is a 
OO ■ classical strategy in computer science [T]: the idea is to 
\l # , use thermal fluctuations to avoid trapping the system in 
CnI local minima, and thereby efficiently visit the whole con- 
,— 1 | figuration space. It has been proposed to extend this ap- 
5^ ■ proach to quantum fluctuations [2] ; it is thus of interest to 
. . \ ask whether annealing by tuning down the amplitude of a 

■ quantum mechanical kinetic operator such as a transverse 
^> , magnetic field T can outperform the classical approach. 

' In particular, can problems that normally take exponen- 
?3 \ tial time be solved in only polynomial time? 



XORSAT [9 . As we shall see, this implies the failure of 
quantum annealing for the hardest optimization problems. 

The reason why quantum annealing is not an efficient 
strategy for finding the ground state across a first-order 
transition can be understood from a simple argument. 
Quantum annealing could in principle be more efficient 
than thermal annealing for certain classes of problems: 
From the WKB approximation it is well known that a 
quantum particle tunnels rapidly through very high (in 
energy) but thin (in distance) energy barriers. Thermal 
annealing is much better at low, but deep barrier crossing. 
However, in a first-order transition the two states whose 
free energies cross are generally far from each other in the 
phase space; quantum tunneling must be inefficient. 

To make this argument more precise, and to compute 
how slow an annealing should be such that the tunelling 
do happens, one can consider the Landeau-Zener theory 
of level crossings [2]. During an avoided crossing, the 
time needed in order to actually reach the ground state 
is bounded by the inverse of the energy gap A between 
these states. If the total annealing is longer r 3> A~ 2 , 
then the adiabtic theorem imply that at each time step, 
the systems remains in the ground state. Otherwise, the 
system misses the crossing and is not in the ground state 
at the end of the computation. A good estimates of the 
running time of the algoritmh is thus obtain by the mini- 
mal energy gap A m i„ during the annealing process [2]. 

We will see that mean-field first-order transitions have 



Some considerable effort has been devoted to this ques- 
tion in the context of difficult combinatorial problems (see 
for instance [3]) which have a counterpart in statistical 
physics where they corresponds to mean-field spin-glass 
models [H[S]. However, most of the studies were purely 
numerical and thus restricted to very small sizes due to 
the difficulty of simulating quantum mechanics without a 
quantum computer. In a recent Letter \§\ (see also [7]), we 
argued that with the usual implementation of the quantum 
annealing it is likely that the most difficult systems un- 
dergo a quantum transition of the first order as the trans- 
verse field is tuned; this is a generic feature for many quan- 
tum spin glasses [5] . More recently, a first order transition 
has indeed been indentified in the phase diagram of one 
of the most studied random optimization problems, called 
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generically an exponentially small gap A oc Ne~~ aN where 
N is the system size. This implies T>e lV , that is to say: 
quantum annealing is an exponentially slow algorithm for 
a mean-field system with a first-order transition^. 

The goal of this Letter is to illustrate these features via 
a complete analytical and detailed numerical analysis for 
a family of models. We consider the ferromagnetic p-spin 
model, which reduces to a mean-field ferromagnet for the 
case p = 2 and to the Grover problem when p — > oo . We 
show how to solve the thermodynamics of these models 
using standard tools of statistical physics. We perform 
extensive numerical studies of the gap for the case of p 
finite and odd. By introducing an ansatz for the domi- 
nant instantonic pathways, we show how to compute the 
coefficient in the exponential decay of the gap. 

The simplest quantum ferromagnet. We con- 
sider a Hamiltonian with N Pauli spins a of the form 
H = H z + TV where H z is a function of the longitudinal 
values a z of the spins. T~L Z is thus diagonal in the a z rep- 
resentation. We focus on the ferromagnetic p-spin model: 



H 



(1) 



MP(a z ) 
NP- 1 



YM T (a x ) =-N [m p (a z ) - Tm T (a x )] 



where we have defined the longitudinal magnetization 
M(a z ) = J2i °f an d the transverse one M T (a x ) = J2i °f 
and their magnetization by site m = M/N and m T = 
M T /N . That sort of models were introduced initially in 
a spin-glass context in [H[10]. The ground state of the 
classical problem, when Y = 0, corresponds to all spins 
aligned in the same direction. Whereas both the up and 
down states are valid ground states for even p, the up 
state is the unique ground state for odd p, and we will 
concentrate on this case for simplicity. The case p — 2 is 
the usual Curie- Weiss model, where the transition is con- 
tinuous pTJ[T2]. For p > 2 however, both quantum and 
thermal transitions are discontinuous. Of special interest 
is the limit p — > oo where for p odd m({S}) p — > ±1 if 
m — ±1, and zero otherwise. It leads to: 



n = -ni 



r E- 2 



(2) 



where the function l(x) is 1 if x is true and zero otherwise. 
We now specialize to this p = oo limit. 

The p = oo limit. 

The classical case: Y = 0. The p = oo model is trivial 
in the limit r — > where there are only two levels with 
nonzero energies E — N and E — —N. The partition sum 
is thus Z = 2 N - 2 + 2 cosh j3N so that 

/ = Km -— log (2 cosh pN + 2 N -2) 



1 In finite dimensions one expects that nucleation will help. How- 
ever, optimization problems are not finite dimensional generically. 



^log (^(l + e^ 10 ^))) 



ss lim 

N^oo /3N 

= min (/>, f P ) with f F = -1 and fp = - 



log2 

P 



One recognizes a first-order transition at /3 C = log 2 be- 
tween two phases that are always locally stable (no spin- 
odal) : a ferromagnetic phase that consists of the classical 
configuration where all spins are up for j3 > j3 c and a triv- 
ial paramagnetic phase at larger temperature. 

The extreme quantum case: T = oo. When T is large 
the classical part of H can be neglected; we then find, in 
the a x basis, N independent classical spins in a field T: 



f QP = —T log 2 — T log (cosh T/T) . 



(3) 



The entropy density is given by the logarithm of a binomial 
in [— YN, TN\: this is a perfect quantum paramagnet. 

The general case. For r = and inverse tempera- 
ture P < log 2 we saw that the classical model is just a 
model where (almost) all configurations have zero energy. 
In this case, we thus can ignore the two nonzero levels and 
we expect the quantum paramagnetic free energy /qp to 
be valid for all Y. A simple perturbation computation 
- given in the next section- shows that this is true in 
the low-temperature phase as well, when f3 > log 2. The 
system thus has two distinct phases, the first a quantum 
paramagnetic and the second a ferromagnetic phase. A 
first-order transition occurs when the free energies cross 
so that / = min(fQp, fp). The phase diagram of the 
model is very simple: For low Y and T, the free-energy 
density is that of the classical model in the ferromagnetic 
phase, while for larger Y it jumps to the quantum param- 
agnetic free energy; a first-order transition separates the 
two different behaviors at the value Y such that fp — Jqp; 
this happens on the line defined by 



1 e p 
Y = — arccosh— 
P ^ 



(4) 



where the magnetization jumps from to 1 (see Fig. [IJ. 

The zero-temperature behavior can be understood from 
standard Rayleigh-Schrodinger perturbation theory [T3] . 
Consider the set of eigenvalues Ek and eigenvectors \k) of 
the unperturbed model, when T = 0. The series for the 
lowest perturbed eigenvalue E m i n (T) reads 



T^rnin (T) E n 



YV,,, 



E 



k rain 



E n 



Eu 



(5) 

Since Vij 7^ if and only if the two configuration i and j 
differ by a single spin flip, odd orders do not contribute 
in Eq. Noting that J2k^n \^nk\ 2 reduces to a sum 

over the N levels connected to Ei by a single spin flip, 
and using the fact that all Ek = (except E min — — A), 
succesives terms are easyly computed and one finds, to all 
(finite) orders (see [6] for a similar computation): 



£™„(r) = -A-r 2 + o(i). 



(6) 



p-2 



Energy gaps in quantum first-order mean-ficld-likc transitions: The problems that quantum annealing cannot solve 



The expansion can also be performed using now TV as 
a starting point and with Ho as perturbation. Consider 
the eigenvalue —NT. In the base | N) corresponding to 
the eigenvalues of TV 0, we obtain 



E(T) = -NT + (N | H Q \ N) + 



\(k\Uy\N){< 
-NT - E k 



(7) 

Denoting a(l) the elements of the vector | N) in the z ba- 
sis, the first-order term in this expansion reads — Na 2 (l). 
Since the a(l) are of order 2~ N / 2 the first-order shift is 
tiny. The next term involves a sum over the 2 N — 1 levels 



V l«(l)fc(l)| 2 
2_, -TN-E k 



-N 



^ -TN 



E k 



(8) 



The last sum is entropically dominated by the states with 
E k — and therefore gives a negligible contribution (as 
one can check term by term). Subsequent terms are 
treated similarly. This yields the ground-state energy: 

E GS = -N-T 2 + o(l) for T < T c (9) 
E GS = -TN + o(l) for T > T c (10) 
with T c = l + 0(1/N). (11) 

Exponential closure of the gap. Near the transition 
the treatment must be refined: There is an (avoided) level 
crossing at T c = 1 in the large N limit between the para- 
magnetic and the ferromagnetic ground state. We now 
compute the behavior of the quantum gap around T c = 1 . 
We write the Hamiltonian in the a x basis: 



Wij — TeiSij + E c aiaj 



(12) 



where a is the state corresponding to all spins aligned 
in the z direction expressed in the x basis. E c — —N 
and SiS are the (binomially distributed) energies due to 
the quantum interaction. With an appropriate conven- 
tion for the eigenvectors we can take for a the vector 
2~ N / 2 (1, l s i 5 ....1). In this basis, on multiplying with an 
eigenvector v of eigenvalue A, we find 

= (Tsi - A) Vi + E c ai(a.v) = Vi + E c (a.v) 

I Si - A 

Multiplying again by a, we find 

a 2 (a.v) 



so that 



(a.v) + E C Y^ 



OAT 



T £l - A 



= 



Tei — A 



= 1 . 



(13) 



(14) 



The qualitative behavior of the eigenvalues can now be 
understood graphically: Between each pole in the denom- 
inator of Eq. (fT4")) the function passes from — oo to +oo 



2 Note that in the u z basis the ground-state vector 
ments ±2 N / 2 . 



N) has ele- 



passing through unity. All interior roots to the function 
are thus bracketed by a comb of poles separated by 2T. 
In the small T phase this rigorously brackets almost all 
the eigenvalues near A = 0. The exception is the lowest 
eigenvalue which can split off from the comb, a sign of the 
phase transition in the large N limit. 

In the paramagnetic phase, the lowest eigenvalue is very 
close to A = — TN. In this case — TN — A is very small so 
that we can write A = — TN+r/. In addition the overwelm- 
ing majority of eigenvalues are close to zero 0; Eq. (HU 
then implies, at the transition when T = 1 



1 



N 
2* 



1 



-N-X 



2 N -1 

-A 



N 



2 N -1 



T}-N 



so that finally rj 2 = N 2 /2 N at the critical point and 

A mm = 2N2- N / 2 . (15) 

The gap closes exponentially fast at the transition. We 
have an extremely simple model with a first-order mean- 
field transition and most of the physics discussed in this 
Letter is already present in this model: difficult problems, 
such as this one where only one in 2 N configurations has a 
low energy, manifest themselves by a first-order transition 
in the quantum annealing path, and consequently by an 
exponentially small gap. 

The reader could at this point argue that we have not 
shown that all choices of the quantum interaction lead to 
this result; perhaps a more intelligent choice would turn 
the transition to second order, and make the gap polyno- 
mial? We know that for this precise model, this is just 
impossible. In fact, this model is nothing else than the 
Grover problem [14] , that is: searching for a minimum 
value in an unsorted database. The best algorithm is 
known, and it is an exponential one |14) . It is obtained 
by adjusting the evolution rate of the Hamiltonian in the 
quantum annealing process so as to keep the evolution adi- 
abatic on each infinitesimal time interval. In doing so, the 
total running time can be t « A~' 15 , which is still ex- 
ponential. There is thus no way to avoid the exponential 
gap in this situation. 

Behavior for general p. — We now consider finite 
value of p and begin by calculating the phase diagram in 
the static approximation. We then consider closure of the 
gap using numerical diagonalization and an instantonic 
calculation which we then compare. 

Phase diagram. We shall first use the Suzuki- Trotter 
formula in order to map onto a classical model with an 
additional "time" dimension: 



{^} 



N 



l im Y{3\ e -ZZ« i^WeE!:, ^ r E 4 <W| 5) . 
{«?} 



3 Systematic corrections to this approximation do not change the 
result. 
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We then introduce N closure relations 1 = J2{&} \<?)(&\ : 

z =e n^)i e "^ (Q)e ^ rEi<(a V(«+i)) 

{*(«)} « =1 



e n 



H(a{a)\e^ r ^^ na) \a(a+l)) 



W°0> 



a=l 



with the convention that a(N s + 1) = cr(l). Applying 
N s times the integral representation of the delta function 
/ dmS(Nm - M({S}))f(Nm) = f(M ({§})), one finds: 

r Ns Nb ( bn N * \ 

Z =J [] dm(a) J] d\(a) exp I ^- £ m(a)^ J x 



exp 



-N 

jv7 



a=l 



JV 5 



VA(a)m(a)+iVlogTrTT el 



IV*(a)+^<7*(a) 



The saddle point condition imposes that A (a) = 
Bpm p ~ 1 (a). Writing t = 0a/N s and performing the limit 
N s — > oo we obtain: 

r rl3 dtVo^ U)+pmP^ 1 (fp z It) 

Z= Vm(t)e N L dt(l- P )^(t )+ N loS Tr Jo 

(16) 

We now use the "static" approximation, which we also 
check numerically [HJ[l2], and remove all "time" indices 
for to to finally obtain: 



(17) 



f(B,T,m) = (p- l)m p --log2cosh [ByjT 2 + p 2 m 2 P- 2 

All thermodynamic quantities can now be computed. For 
instance, the self-consistent equation for the magnetiza- 
tion to reads (for p > 2) 



/ tanh (yVr 2 +P 2 m 2 P~ 2 
I ^r 2 + p 2 m 2 P= r 



pm 



p-i 



(18) 



It is easy to check that the former expression leads to first- 
order (quantum and classical) transitions when its minima 
cross. In particular, the free energy for p — > oo is simply 
/ = — 1 for m — 1 and / = — jj log 2 cosh (/3T) otherwise, as 
we obtained in the first section. The phase diagram of the 
model is plotted in Fig. [1] 

The energy is given by e = -§sPf, and thus at low T: 



- p 2 m 



e(P) «e GS + 2v/n 
with ecs(r, to) = (p — 1)to p — \/T 2 + 



2p-2 



In the low-temperature T, the energy of a system with 
N excited states with an energy gap AE is E = Eqs + 
NAEe~ l3AE , and this computation thus shows that there 
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Fig. 1: Phase diagram of the ferromagnetic p-spin ferromagnet 
for different values of p. A first-order transition separates the 
ferromagnetic and quantum paramagnetic phases. 



p 2 m 2p 



are N levels with an energy gap AE = 2VT2" 
where AE is discontinuous at the transition. 

This is, however, only a crude description of the phe- 
nomenology of the low-lying states. If indeed only one 
level is closing at the transition, then we expect the en- 
ergy to behave as E = Eqs + AEe~ l3AE ' , and therefore 
one needs to compute the O(l) correction to the energy in 
order to take this into account. The former computation 
thus misses this behavior and indeed, numerical results 
show that the first excited state is unique. Worse, we 
expect the energy gap between the ground state and the 
excited state to close exponentially fast at the transition, 
and therefore, in order to be able to investigate this be- 
havior, we should be looking for an exponentially small 
gap: in that case we thus need to look for exponentially 
small correction to the free energy! Fortunatly, there is a 
way to deal with this problem: we now turn to a numerical 
study of the gap and to the instantonic approach. 

Closure of the gap. 

Numerical methods. We use two complementary 
methods to study the spectrum of the p-spin model for 
3 < p < 31 . The full matrix representation of the Hamilto- 
nian is a sparse operator of dimension 2 N . For such sparse 
matrices Laczos methods are particularly useful and can 
be used to extract extremal eigenvalues from the spectrum 
for ./V < 21. We note in particular that that for N < 21 the 
transition occurs between two states with the maximum 
possible angular momentum I — N/2. 

Considerable improvements in efficiency are obtained by 
realazing that the total angular momentum L 2 commutes 
with %. Thus the transition occurs in a subspace of di- 
mension 21 + 1 = N+ 1. In this subspace the Hamiltonian 
has diagonal elements corresponding to different values of 
L z . Standard methods from the theory of angular momen- 
tum show that the off-diagonal elements of the matrix in 
this subspace are only those labeled by (m z ,m z ±1). The 
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Fig. 2: Numerical computation of the gap versus V for p = 3 Fig. 3: Minimum Gap versus N from exact diagonalization 

computed using the method described in the text. Very close of the ferromagnetic p-spin model for some values of p on a 

to the transition at T c (the black vertical line), in a region that linear-log scale. One clearly sees that for each p the gap closes 

shrinks as AT increases, the gap is closing exponentially fast. exponentially with N, so that A m i„ oc N2~ Na . 



matrix is symmetric with off-diagonal elements 

H m „™,+i = + 1) - m z (m 2 + 1) (19) 

The resulting tri-diagonal matrix an be treated with very 
high efficiency allowing one to study systems of N ~ 100 
in just a few seconds. The limiting factor in the study of 
even larger systems is the reduction of the gap to double 
precision machine accuracy so that floating point round-off 
errors dominate the results. Fig. [3] shows the dependence 
of the minimum gap for some values of p. We see that for 
all p > 3 the gap closes exponentially in N. 

Fig. [2] shows the dependence of the gap A as a function 
function of T for p = 3 and different N. A indeed closes 
fast at the transition that arises exactly at the critical 
value predicted analytically. The region where the gap 
closes is getting narrow as N increases, and one has to 
be very careful in scanning T in order not to miss it: this 
is an important message for future numerical simulations. 
Fig. [3] shows the dependence of the minimum value of the 
gap Amin as a function of ./V for some values of p. For all 
p > 3, the gap decays exponentially as A min oc N2~ Na . 
The different values of a are given in Table [1] As we 
expected, the gap closes exponentially fast at the first- 
order transition point. We want now to show how the 
coefficient in the exponent can be computed analytically. 

The Instantonic approach. It is well known that the 
tunneling between quantum states can be computed using 
an instantonic approach |16) . Let us briefly explain how 
this can be understood via corrections to the saddle-point 
computation. At the transition, two solutions (the ferro- 
magnetic one to = m eq and the paramagnetic one to = 0) 
have the same free energies f m = /qp- Let us assume now 
that we are able to find another time-dependent path 771(f) 
— which we shall call instantonic — that spends some time 
T\ in the ferromagnetic state and then jumps to the para- 
magnetic state where it spends a time Ti , and that exactly 



at the transition, one has e = e~ N ^^ inst ~^ f ' rro ' > — e~ NG 
with G = 0(1) in the zero-temperature limit. Since we 
are summing over all periodic paths, one should now take 
into account all such instantonic paths that jump an even 
number of times to compute the correction to Eq. (fl~8|) . 
Each of these jumps can occur at any time t £ [0,0] and 
the saddle-point computation thus reads, at the transition: 

Z = 2e-^ + 2e^(^ + ^ + ^ + ...) 
= 2 E 1^-^, (20) 

k even 

where the factor (3 k jk\ comes from the counting of all pos- 
sible paths with k jumps. One then recognizes the series 
expansion of an effective two level system: 

Z = Tr e~ m *if, with H e ff = ( ^ J, V (21) 

Diagonalizing the effective Hamiltonian at T = one sees 
immediately that the gap goes as A oc e = e~ NG : the 
energy cost of the instanton thus provides the exponent of 
the gap at the transition. 

Computing the Instanton. We can consider various 
ansatze to compute the optimal instanton, all of them giv- 
ing lower bounds on the coefficient. The simplest one is 
just a sharp wall when 771(f) jumps abruptly from the value 
toq to to p . The gap thus reads in this approximation^ 

A = (F\Q) N ^e Nlo ^ F ^ (24) 

4 This can be seen in the discrete Suzuki-Trotter formalism where 

Z= nW«)F (r °" ( ° 1+ '"\(« + l))- (22) 

Each term but one can be written in its respective diagonal base (1) 
or (2) and be computed with the static approach. However, there is 
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Table 1: First-order transition in the p-spin ferromagnet at 
zero temperature: The critical values for the field F c and mag- 
netization m c are given. The gap at the transition decays ex- 
ponentially fast as A oc N2~ Na P and we give the numerical 
results from exact diagonalization a Ga ^ , the estimates with 
the sharp instanton a s ^ rp (an upper bound on the true value) 
and the soft instanton a t ^ h : these values are indistinguishable 
from the numerical ones. 



where (F\ and (Q\ are the eigenvectors of the matrix 

( Pm r -pmP- 1 ) (25) 

Exactly at the transition, this gives an estimates on the 
gap A. In particular for p — > oo, we find that A ss 
N2~ N / 2 , as was previously found in the first section. For 
finite p, however this yields only a crude lower bound on 
the value of the exponent (see Table [l| . 

We thus use a tanh shape for m(t) and compute numer- 
ically the cost, by integrating Eq. (fTfJ)) . We use the width 
of the tanh function as a variational parameter which we 
vary in order to minimize the estimate of the instanton free 
energy from which we deduce the gap. The results of this 
procedure are given in Table [TJ When we now compare 
the numerical data from exact diagonalization with the 
prediction from the instantonic computation, we observe 
that there is no detectable difference within our numerical 
precision between the instantonic prediction from the tanh 
shape and the numerical estimation of the coefficient. We 
have thus obtained A from first-principle computations. 

Conclusions. — Quantum annealing has been pre- 
sented as a new way of solving hard optimization prob- 
lems with complicated and rough configuration spaces. In 

a remaining term of the form 
{<n\e N *^ |cr 2 > = {ai\(T2){cn\e v » |oi) (23) 



this paper we have shown that even in systems with trivial 
energy landscapes quantum annealing can fail (and there 
is thus no need for more complex phenomena to explain 
this failure, as for instance in [171 ). Already the p = 3 
ferromagnet exhibits a first-order phase transition with 
an exponentially closing gap: A scenario which is very 
pessimistic for the success of the quantum annealing al- 
gorithm. We have also shown that the p = oo limit of 
the ferromagnetic model is related to the Grover problem. 
This is a clear indication that these first-order transition 
carry the signature of the most difficult problems. 

Models presented in this Letter allow a complete ana- 
lytical and numerical treatment. Their disordered coun- 
terpart can be studied using the generalized instanton in- 
troduced in It would be interesting to extend this 
approach to dilute mean-field system and random opti- 
mization problems, using the quantum cavity of [9lll2j. 

* * * 
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